Feedback Control of Non-linear Quantum Systems: a Rule of Thumb 
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We show that in the regime in which feedback control is most effective — when measurements are 
relatively efficient, and feedback is relatively strong — then, in the absence of any sharp inhomo- 
geneity in the noise, it is always best to measure in a basis that does not commute with the system 
density matrix than one that does. That is, it is optimal to make measurements that disturb the 
state one is attempting to stabilize. 
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The manipulation of quantum systems using contin- 
uous measurement and feedback control has generated 
increasing interest in the last fewyears, due to its poten- 
tial applications in metrology 0, S, communication 0, Q 
and other quantum technologies [a, @, 0, S, El , as well as 
its theoretical interest, connecting as it does the well- 
developed field of classical control theory [3] to funda- 
mental questions regarding the structure of information 
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and disturbance in quantum mechanics 

While the dynamics of closed quantum systems is lin- 
ear, the introduction of continuous measurement renders 
the dynanics both non- linear and stochastic [l3j]. In cer- 
tain special cases the resulting evolution can be mapped 
to a linear classical system driven by Gaussian noise, 
and as a result classical control theor y fo r linear systems 
solves the optimal control problem [hi . HR Il6j |. How- 
ever, most quantum systems are not amenable to this 
technique, and experience from non-linear control the- 
ory in classical systems tells us that is unlikely that one 
can obtain general analytic results for optimal quantum 
feedback control. However, it may be possible to obtain 
general insights or "rules of thumb" that can act as guid- 
ing principles in the design of control algorithms. Here 
we ellucidate one such generaly applicable principle. 

The equation describing the dynamics of a quantum 
system with arbitrary Hamiltonian H subjected to con- 
tinuous measurement of an arbitrary observable X is 
given by the stochastic master equation (SME) [ij], EH 

dp = -{i/h)[H,p]dt-k[X,[X,p}]dt 

+4k[Xp + pX-2(X)p](dr-(X)dt), (1) 

where k is the strength of the measurement (loosely the 
rate at which it extracts information ll|) and p the sys- 
tem density matrix. The observer's measurement record 
is r(t) where dr = (X)dt + dWj V8k and dW is Gaussian 
white noise satisfying the relation dW 2 = dt Feed- 
back control is implemented by continually changing the 
Hamiltonian in response to the continual stream of mea- 
surement results. That is, by making H(t) a function of 
r(t') for all t' < t. We note that the SME is invariant 



under the transformation X — > X + al where a is a real 
number, so we may always take X to be traceless without 
loss of generality. In addition, many natural observables 
have equi-spaced eigenvalues (e.g. excitation number in 
a harmonic oscillator). In explicit calculations we will 
take X to have the eigenspectrum of J z , since this is both 
traceless and equi-spaced, although we do not expect this 
choice to have any important effect on the results. 

In feedback control one is usually concerned with sta- 
bilizing a quantum system in a given state in the presence 
of noise, or stabilizing it about a given evolution, and it 
is this large class of problems that we will consider here. 
In what follows we will explicitly analyze the problem of 
stabilization about a specific target state, although our 
results will also apply to stabilization about a given evo- 
lution, since this can be viewed as the former problem in 
which the target state changes with time. We will denote 
the target state by |0), and use as our measure of suc- 
cess the probablity, P, that the system will be found in 
the target state apon making a measurement. The goal 
of feedback is thus to keep P as close to unity as pos- 
sible. We will assume minimal constraints on the feed- 
back Hamiltonian and measured observable, since we are 
interested here in general properties of quantum control, 
rather than constraints that are applicable to specific sys- 
tems. That is, we will assume that the controller has the 
ability to apply any feedback Hamiltonian H such that 
Tr[H 2 ]/h < p 2 for some number p, and to measure any 
unitary transformation of J z . If |0) is an cigenstate of p, 
then P is equal to the correponding eigenvalue. 

The first important fact we note is that, given an ar- 
bitrary system density matrix p, with eigenvalues {\ : 
2 = 0,..., N} then P is maximized by applying a Hamil- 
tonian to rotate the system so that |0) is the eignevector 
corresponding to the largest eigenvalue [ll|. Because of 
the minimal constraints on the measurement, this means 
that under the assumption that the noise is homogeneous 
in the vicinity of the target state, it is always optimal to 
chose H(t) so that |0) remains as close to an eigenvector 
of p as possible. This is because any unitary transforma- 
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tion of p can be compensated for the purposes of feedback 
by applying the inverse unitary to the measured observ- 
able X. Thus for homogeneous noise, choosing H to 
"eigenvectorize" the target state has no adverse effects, 
and thus optimizes P at all times. 

We will assume now that we are in the regime of good 
control so that the condition A = 1 — P <C 1 is main- 
tained by the feedback algorithm as the evolution pro- 
ceeds. This is an important condition because it will al- 
low us to perform an analysis to first order in A. We will 
also assume that the feedback Hamiltonian is sufficiently 
strong that it is able to keep the target state close to an 
cigenstate of p to good approximation, and that the noise 
is homogeneous around the target, ensuring that such a 
procedure is optimal. This will allow us to analyze the 
performance of the control algorithm purely in terms of 
the eigenvalues of p. Generally one would expect to be 
in the regime of good control whenever p 2 3> k 2 ^> /? 2 , 
where /3 is the average strength of the noise driving the 
system, and will be defined precisely below. 

We choose Ao to be the largest egenvalue, and from our 
second assumption P = Ao, and A = Y^iJ^ ^i- We also 
note that the von Neuman entropy S(p) and the linear 
entropy L{p) are given by S(p) = L(p) = 1 — Tr[/? 2 ] = 
2A + 0(A 2 ). We now wish to ask how the basis in which 
we choose to measure affects our ability to control the 
system. Once we have chosen the eigen-spectrum of the 
observable X, we are free to choosen any eigenbasis for 
this observable, all of which are obtained by applying a 
unitary transformation to X so that the measured ob- 
servable becomes X = UXU^. We now evaluate the 
infinitcssimal change in the von Neuman entropy due to 
the measurement, dS, for two "extreme" choices of the 
measurement basis. In the first case we chose X so that 
it commutes with p, and in the second we choose the ob- 
servable to be X u = X where U is chosen so that X u has 
a basis which is unbiased with respect to the eigenbasis of 
p. This means that every eigenvector of X u has an equal 
projection of magnitude 1/yN onto all the eigenvectors 
of p • In this sense the basis of X u is maximally non- 
commuting with the eigenbasis of p. We will refer to the 
measurement of X commuting measurement, and 

the measurement of X u as an unbiased measurement. To 
calculate the infinitesimal change in entropy due to the 
measurement we use Eq.([T]) with H = and the fact 
that dS = dL = -d{Tr[p 2 }) = -Ti[2 pdp + (dp) 2 }. For 
the commuting measurement this gives 
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where the Xj are the eigenvalues of X. To first order in 
A the decrease in entropy caused by the measurement is 
thus entirely stochastic. In particular, since (dW) = 0, 
the average change in the entropy is zero to first order in 
A; the deterministic decrease caused by the measurement 



is second order in A. After each infinitcssimal time-step 
dt, we have the oportunity to apply a Hamiltonian so as 
to transform the system with a unitary U (dt) = e - lHdt / h . 
However, this unitary cannot change S, and since X c 
commutes with p the target state remains an eigenstate 
of p after the measurement. As a result Hamiltonian 
feedback is not able to contribute to the control process, 
at least in the regime of good control. For feedback to 
be effective one must wait until the noise has disturbed 
the system to the extent that Ao is no longer the largest 
eigenvalue, at which point feedback can be used to swap 
the eigenvalues and restore this status to Ao- 

To calculate the change in entropy resulting from a 
measurement of X u we proceed as before, but this time 
note that 1) the diagonal elements of X u = UXU^ are 
zero due to the fact that X is traceless, and 2) that an 
unbiased observable A has the property that tr[A m p™] = 
ix[A m p]tr\p n ] = (,4 m )tr[p™] [2l|. The result is 
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dt + 0{A 2 ). (3) 



In sharp contrast to a measurement that commutes with 
p, we see that this time the measurement induces a reduc- 
tion in the entropy of the system to first order in A, and 
further, that this reduction is purely deterministic. This 
shows us immediately that unbiased measurements are 
much more powerful for feedback control than commut- 
ing measurements. For measurements that are neither 
commuting nor unbiased, in general neither the deter- 
ministic nor the stochastic terms will vanish. Thus non- 
commuting measurements on average induce a reduction 
in entropy to first order in A, but the rate of reduction 
fluctuates randomly. Non-commuting measurements arc 
therefore superior to commuting measurements for feed- 
back control, which is our primary result. 

The above result allows us to derive a particularly sim- 
ple formula for the performance of a feedback algorithm 
in the regime of good control employing an unbiased mea- 
surement with strong feedback, and in the presence of 
isotropic noise. To do so we merely need balance the 
rate of entropy increase due to the noise with the de- 
crease due to the measurement. When the system state 
is nearly pure, then the rate of entropy production is ap- 
proximately independent of A. For example, for isotropic 
dephasing noise in a single qubit (whose contribution to 
the master equation is dp no i sc = (3 ^2 k [o~k, [o~k, p]]dt where 
k = x,y, z) the rate of entropy increase is S — 4/3— 0(A). 
For an N dimensional system we will correspondingly de- 
fine the noise strength /3 as 5/4 where S is the rate of 
entropy increase due to the noise. When k 3> (3 the 
steady state performance of a feedback algorithm using 
unbiased measurements and strong feedback is thus 
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Here we have used the fact that on average under 
isotropic noise all the small arc equal to A/(iV — 1). 

The above analysis immediately raises two questions. 
Since measurements that do not commute with p are 
more effective at reducing the entropy, one might ask 
whether it is the unbiased measurements (being the ones 
that are maximally non-commuting) that provide the op- 
timal entropy reduction. The second question is whether 
all unbiased measurements are equally effective. It turns 
out that while the answer to the first question is yes for 
qubits (this was shown in 12]), it is not the case for 
higher dimensional systems. To show this we performed 
a numerical study of (dS) as the measurement basis is 
transformed from one that commutes with p to one that 
is unbiased. That is, we explored the bases given by 
the unitary transformations U (e) = e teA for e G [0, 1] 
where U(l) corresponds to an unbiased basis. We did 
this for each of a set of mutually unbiased bases for three 
and four dimensional systems (specifically we used those 
given in [20| ) and for a random sample of a thousand 
density matrices p. We find that in many cases the max- 
imum of (dS(e)) occurs for e < 1. 

To answer the second question we need to examine 
the matrix elements X^ . If we write the eigenvectors of 
X u as v rn , and their respective elements as v m j, then 
the elements of X u are given by X™i = J2k c mjXk 
where theXfc are the eigenvalues of X and cj^ = Vk m Vkj- 
Since all the elements v m j have the same magnitude, and 
since the v m are orthonormal, for every m 7^ j the set 
{cjj,j : k = 0, . . . , TV — 1} lies on a circle and J2k c mj = 0- 
Because of this a simple geometrical argument shows that 
for systems with two or three dimensions, when X = J z 
the magnitudes of all the off-diagonal elements of X u are 
identical and equal to 1/4 and 1/3 respectively. Thus for 
qubits and qutrits all unbiased bases are equally good for 
feedback control with observables with equispaced eigen- 
values. In four dimensions, however, an explicit calcula- 
tion shows that in general the unbiased bases produce a 
set of elements |-X"° J '| 2 that are unequal. In this case the 
effectiveness of the basis can be changed merely by per- 
muting the basis vectors, and thus all unbiased bases are 
no longer equal for feedback control. At each time-step 
one would ideally use the basis that maximizes \dS\. 

We now examine how the above results manifest them- 
selves quantitatively in a concrete application. We con- 
sider two feedback control algorithms for a single qubit, 
the first based on a measurement that commutes with 
the target state, and the second employing an unbiased 
measurement. In the first case we are able to obtain a 
feedback algorithm that is almost certainly optimal for 
strong feedback, and then compare this with the perfor- 
mance of the second. In both cases we choose the noise 
to be isotropic so that dp nolsc = PJ2k\- a ki Wk,p]]dt. 

For the first algorithm we chose to measure the observ- 
able o z , the target state to be |— ) where <r z \±) = ±|±), 
and write the density matrix in the eigenbasis of a z . 



Steady-State Probability Density Performance of Feedback Control 




FIG. 1: In (a) we plot the steady-state probability density 
for P, being the squared overlap with the target state, in 
the absence of feedback. Solid line: k/P = 2; Dashed line: 
k/P = 1/2; Dash-dot line: k/P = 0.1. In (b) we plot the av- 
erage steady-state probability that the system is found in the 
target state under two feedback algorithms. Solid line: Feed- 
back control using an unbiased measurement with feedback 
strength ^ — > 00; Circles: Same algorithm with /j, = lOOfc. 
Dashed: Feedback control using a measurement that com- 
mutes with the density matrix for /i — > 00. Squares dashed: 
Same algorithm with p = lOOfc. 

Since both the noise and the measurement of a z con- 
tinually destroy the off-diagonal elements of p, in the 
absence of feedback we need only consider the diago- 
nal elements of p, and thus p is completely specified 
by a single dynamical variable, P, being the probabil- 
ity that the system is in the target state, or equiv- 
alently z = (a z ) = 1 — 2P. The stochastic master 
equation then reduces to a stochastic equation for z 
being dz = -Af3zdt + V8k(l - z 2 )dW . The Fokker- 
Planck equation for the probability density of z, p(z,t), 
is d tP (z,t) = Af3d z [zp{z,t)} + 4kd 2 [{l - z 2 ) 2 p(z,t)}. We 
solve this to obtain the steady-state probability density 
for z, which is 

Pss (z) = AT 1 exp {f3/[2k(z 2 - 1)]} (z 2 - l)- 2 , (5) 

where Af is the normalization. We find that as the mea- 
surement strength is increased with respect to the noise 
power, p ss (z) is increasingly peaked close to the values 
z = ±1; as k is increased, the system spends more time 
in the near-pure states |±), and less time in the mixed 
no-mans-land between the two. This is the regime in 
which the system exhibits well defined quantum jumps 
between these states at random intervals. Figure 1(a) 
shows Pss(z) for three values of k/(3. 

We now wish to add feedback so as to keep the system 
as close to |— ) as possible. Since Hamiltonian evolu- 
tion can only rotate the state on the Bloch sphere, when 
P > 0.5 feedback can only decrease P. We therefore ap- 
ply a feedback Hamiltonian only when P < 0.5. In this 
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case a rapid it rotation on the Bloch sphere will transform 
P — > P' ~ 1 — P. The key question we must answer is 
how long we should wait to apply this rotation. If we wait 
until P is very small, then the rotation will bring the sys- 
tem very close to the target state, but the system will also 
spend more time far from the target state. To answer this 
question we need to solve for the steady-state density in 
the presence of the feedback algorithm. In implementing 
the feedback we choose to turn off the measurement when 
applying the rotation. This both simplifies the analysis 
and is advisable since the measurement will interfere with 
the rotation through the quantum Zeno effect. In addi- 
tion, for strong feedback the rotation takes little time so 
that removing the measurement has a negligible adverse 
effect on the entropy. 

In the limit of strong feedback, it turns out that we can 
include the effect of our feedback algorithm, in which we 
perform a ir rotation when P reaches the threshold value 
Pr, simply by changing the boundary conditions on the 
Fokker-Planck equation: with the feedback we now have 
an absorbing boundary at z = 1 — 2Pp = — e, and the 
point z = e has an extra probability flux equal to that 
flowing out the absorbing boundary. The solution for the 
steady-state density is now 



A + B 



exp{/3/[2fc(l - x 2 )]}dx Afp 



where for z g [- 
Cj; exp{/3/[2fc(l 
l/A = C/2 and 



-e, e] we have l/A - 
- x 2 )]}dx, while for 
B = 0, where C \ 



(6) 

C and 1/B = 
G [e, 1] we have 
Jl e p ss (x)dx + 



2 J 1 p ss (x)dx. Evaluating the integrals numerically we 
find that the optimal threshold is e = 0, corresponding 
to Pt = 0.5. Thus one should apply a ir rotation to the 
system as soon as the state crosses the center of the Bloch 
sphere. We plot the performance of this algorithm, given 
by the steady-state average success probability, (P) ss , as 
a function of k/ (3 in Figure 1(b). 

In addition we perform numerical simulations to obtain 
the performance of this algorithm for a finite feedback 
Hamiltonian. In this case the threshold is no longer the 
center of the Bloch sphere: when |e| is tiny the system 
will tend to cross the threshold immediately the feedback 
rotation is complete, invoking a further rotation and ef- 
fectively freezing the system within the ball z G [— e,e\. 
We choose a feedback strength of /i = lOOfc, and find 
numerically the optimal threshold for each value of k/ (3. 
The resulting performance is shown in Figure 1(b). 

We now evaluate the performance of a feedback al- 
gorithm that uses an unbiased measurement. In this 
case at each instant we choose to measure an observable 
whose basis is unbiased with respect to p. In the limit of 
strong Hamiltonian feedback (yu — > oo) we can maintain 
the direction of the Bloch vector pointing towards the 
target, so the performance measure P is simply deter- 
mined by the linear entropy of the state via the relation 



L = 2P(1 — P). In this case wc can obtain a simple 
analytic expression for the performance. The rate of in- 
crease of L due to the noise is L = 4/3(1 — 2L) and the 
rate of decrease due to the measurement is L = —8kL. 
The steady-state value of L is the point at which these 
rates cancel, and is thus L ss = (l/2)(/3/(/c + /?)). This 
gives P ss = 0.5[1 + \Jkj{k + (3)]. To give an example of 
the performance with a specific finite feedback strength 
we also perform a numerical simulation with /j = lOOfc. 
We plot P ss as a function oik/ (3 in Figure 1(b) and com- 
pare it to that achieved with the commuting feedback 
algorithm above. As expected the algorithm employing 
the unbiased measurement significantly outperforms the 
algorithm that uses the commuting measurement. 
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